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PROTOCOL AND METHOD FOR PEER 
NETWORK DEVICE DISCOVERY 

FIELD OF INVENTION 

This invention relates to computer networks. More 
specifically, it relates to a protocol and method for peer 
network device discovery in computer networks. 

BACKGROUND OF THE INVENTION 

The Internet is a world-wide network of interconnected 
computers. One component of the Internet includes a large 
number of individual networks called Autonomous Systems 
("AS"). Autonomous Systems include network topologies 
that typically have a single administrative entity. Examples 
of Autonomous Systems include universities (e.g., mit.edu, 
wisconsin.edu, etc.), corporations (3com.com, 
microsoft.com, etc.) and Internet Service Providers ("ISF') 
(e.g., aol.com, mci.com, etc.). An individual Autonomous 
System may include one or more Local Area Networks 
("LAN") connected by bridges or routers. As is known in the 
art, bridges store and forward data frames between network 
topologies, while routers translate differences between net- 
work protocols and route data packets to appropriate devices 
on a network topology. An Autonomous System may also 
include Wide Area Networks ("WAN") running point-to- 
point or switched protocols. 

Most Autonomous Systems comprise LANs connected by 
bridges or routers and only carry traffic to or from their own 
domain. Such Autonomous Systems are referred to as "stub" 
or "edge" networks and are typically interconnected to the 
Internet by a number of independent high speed backbone 
networks. Connectivity to the Internet in Autonomous Sys- 
tems is often ad-hoc and based on administrative preferences 
rather than performance criteria. For example, network 
traffic between a first Autonomous System and a second 
Autonomous System in the same city may pass through 
another city tens or hundreds of miles away since the first 
and second Autonomous Systems may connect to the Inter- 
net through different backbones. 

In some cases, multiple edge networks may be part of the 
same administrative entity. Large organizations with mul- 
tiple sites use Virtual Private Networks ("VPN") comprising 
multiple edge networks. Instead of using dedicated long- 
haul Lines between sites, a VPN with Autonomous Systems 
connects each site through the Internet with an "edge router" 
or "firewall" typically capable of data encryption and/or data 
authentication. Data packets, such as Internet Protocol 
("IF') packets are encrypted and routed to the Internet 
traveling between multiple sites in the VPN. As is known in 
the art, IP is an addressing protocol designed to route traffic 
within a network or between networks. 

Within an Autonomous System, routing and connectivity 
are typically determined by the organization's network 
administrator. Routing can be either static (e.g., statically 
assigned into a network device) or dynamic (e.g., using 
routing protocols such as Routing Internet Protocol ("RIP"), 
Open Shortest Path First ("OSPF"), etc.). For small to 
medium size Autonomous Systems, internal routes to the 
Internet do not change very often. Incoming and outgoing 
Internet traffic typically passes through a single router called 
a "gateway" or "edge router." As is known in the art, a 
gateway stores and forwards data packets between dissimilar 
network topologies. However, on the Internet, routing is 
typically very dynamic. Paths between Autonomous Sys- 
tems through the Internet may change minute -by-minute or 
they may remain static for long periods of time (e.g., days 
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or weeks). Paths between Autonomous Systems may 
traverse several different backbones to complete an Internet 
connection. Routing on the Internet is discussed in "End- 
to-end routing behavior on the Internet," by V. Paxson in 

5 IEEE/ACM Transactions on Networking, Vol. 5, No. 5, pp. 
601-615, Octerber 1997, incorporated herein by reference. 

There arc several problems associated with two or more 
Autonomous Systems with edge routers or firewalls using 
static routine to connect to the Internet, which uses dynamic 

10 routing. The Internet typically suffers from significant per- 
formance problems including excessive data packet delays 
and data packet losses that may addressly affect the Autono- 
mous Systems. The data packet delays and losses typically 
occur at public Network Access Points ("NAF') and private 

15 switches. Within each Autonomous System, network admin- 
istration planning and fault tolerance can accommodate 
reasonable traffic growth for Internet connections. However, 
at Network Access Points, it is difficult to upgrade and 
maintain edge routers because multiple administrative enti- 

20 ties for multiple Autonomous Systems arc involved. 

There have been attempts to provide "intelligent" capa- 
bilities to edge routers. Intelligent edge router capabilities 
may include: Forward Error Correction ("FEC"), where loss 
resiliency is achieved by employing Forward Error Correct- 

25 ing Schemes, such as exclusive -OR ("XOR"), Reed- 
Solomon codes, or other forward error correcting schemes 
known in the art; encryption, where performance and end- 
to-end privacy is enhanced with edge routers that encrypt 

3q packets that are being sent to edge networks with similar 
capabilities; compression, where performance is increased 
and bandwidth is reduced if packets are compressed and sent 
edge-to-edge; or other intelligence. 
The "intelligent" edge router services described above 

35 and other services known in the art typically require that 
edge routers be able to identify each other (e.g., to negotiate 
an encryption or compression scheme). However, there is 
currently no mechanism to allow edge routers to identify one 
other using networking protocols (e.g., Transmission Con- 

4Q trol Protocol "TCP" ). As is known in the art, TCP provides 
a connection-oriented, end-to-end reliable protocol designed 
to fit into a layered hierarchy of protocols that support 
multi-network applications. Thus, it is desirable to provide 
a mechanism to allow "intelligent" edge routers to identify 

45 one another using networking protocols and increase net- 
work performance. 

SUMMARY OF THE INVENTION 

In accordance with a preferred embodiment of the present 

50 invention, problems associated with allowing "intelligent" 
edge routers to identify one another are overcome. A peer 
discovery protocol and peer discovery methods for peer 
network device discovery is presented. The peer discovery 
protocol includes a peer discovery marker for allowing a 

55 network device to discover a peer network device and a peer 
discovery table for storing peer network device information 
from a peer discovery marker. In a preferred embodiment of 
the present invention, the peer discovery marker is used as 
an additional option with an existing networking protocol 

so such as TCP to allow discovery of peer network devices. 
However, the present invention is not limited to using the 
peer discovery marker with TCP, and other networking 
protocols could also be used. 
The peer discovery table is maintained by a peer network 

65 device and is used with information from the peer discovery 
marker to record the existence of peer network devices. The 
peer table provides peer network device information in 
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terms of two-way peef-to-peer data "flows" between subnets 
(etg., peer network devices and associated host network 
devices) rather than connections- between host network 
devices as is typically the case with' router tables. 

One aspect of a peer discovery method for a preferred^ 
embodiment of the present invention. -includes receiving an 
original first data packet from a first%et>vork device (e.g., a 
host network device^ on a secotid network device (e.g.,^an 
edge router) on a first network./The first data packet (e.g.,. 
TCP/IP) is used to establish a connection from the first 
network device on the first network to a fourth network 
device on a second network (e.g., a host network device to 
another host network device). Aipeer discovery marker from 
a peer discovery protocol is added to a header in the first data 
packet on the second network device to create a modified 
first data packet as the packet passes through the second 
n e Jwojr ^de^c e.^Thej peer discovery marker~includes a 
- net;p}rj^ second network device that is trying 

to discover a peer network device. In a preferred embodi- 
ment of the present invention, the peer discovery marker is 
added as an additional networking option to a networking 
protocol such as TCP. The modified first data packet is sent 
from the second network device on the first network to a 
third network device on the second network via the third 
network (e.g., the Internet). 

Another aspect of the peer discovery method for a pre- 
ferred embodiment for the present invention includes receiv- 
ing a modified first data packet on the third network device 
on the second network via the third network. Information 
from a peer discovery marker is extracted and stored in a 
first peer discovery table on the third network device. The 
peer discovery marker is deleted from the header on the 
modified first data packet on the third network device to 
recover the original first data packet. The original first data 
packet is sent to a fourth network device on the second 
network to help establish a connection between the first 
network device and the fourth network device. 

Another aspect of the peer discovery method for a pre- 
ferred embodiment for the present invention includes cre- 
ating a second data packet on the third network device to 
establish a two-way peer-to-peer data flow to the peer 
second network device. The second data packet is created 
after the third network device receives a modified first data 
packet with a peer discovery marker. The second data packet 
can be a TCP, User Datagram Protocol ("UDP") or other 
networking protocol data packet. As is known in the art, 
UDP provides a connectionless mode of communications 
with datagrams in an interconnected set of networks. The 
third network device adds its own network address and the 
network address of its associated host network device to the 
second data packet (e.g., IP addresses). The third network 
device sends the second data packet to the peer second 
network device via the third network (e.g., the Internet). 

Information from the second data packet is extracted and 
stored in a second peer discovery table on the second 
network device, thereby providing network addresses for 
establishing a two-way, peer-to-peer data flow between the 
peer second network device and the peer third network 
device (e.g., peer edge routers) via the third network (e.g., 
the Internet). 

In a preferred embodiment of the present invention, the 
first network device is a host computer, the second network 
device is an edge router, the third network device is an edge 
router, the fourth network device is a host computer. The first 
network and second networks are Autonomous Systems and 
the third network is the Internet. The first and second data 
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packets are TCP/IP data packets, and the header including 
the peer discovery marker is a TCP header. However, the 
present invention is not limited to these network components 
and other network components could also be used. 

The peer discovery protocol and peer discovery methods 
allow peer edge routers and other peer network devices to 
discover one another across a network like the Internet and 
provide "intelligent" edge router services. The peer discov- 
ery protocol and peer discovery method of a preferred 
embodiment of the present invention may enhance 
performance, reliability and security of data transmitted over 
the Internet to and from Autonomous Systems or other 
networks. 

The foregoing and other features and advantages of a 
preferred embodiment of the present invention will be more 
readily apparent from the following detailed description, 
which proceeds with references to the accompanying draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram illustrating a network system for 
peer network address discovery; 

FIG. 2 is a block diagram illustrating a protocol stack for 
a network device; 

FIGS. 3A and 3B are block diagrams illustrating compo- 
nents of a peer discovery protocol; 

FIGS. 4A, 4B and 4C are block diagrams illustrating 
TCP/IP three-way handshake segments for establishing a 
TCP connection; 

FIG. 5 is a flow diagram illustrating a method for peer 
network device discovery; 

FIG. 6 is a block diagram illustrating a peer discovery 
data packet with a peer discovery marker; 

FIG. 7 is a flow diagram illustrating a method for peer 
network device discovery; 

FIGS. 8A and 8B are block diagrams illustrating peer 
discovery tables; 

FIG. 9 is a flow diagram illustrating a method for peer 
network device discovery; and 

FIG. 10 is a flow diagram illustrating a method for peer 
network device discovery. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

Network System 

FIG. 1 is a block diagram illustrating a network system 10 
for preferred embodiment of the present invention. Network 
system 10 includes a first network 12 with multiple network 
devices, two of which arc illustrated. First network 12 
includes a first network device 14 and a second network 
device 16. Second network 18 also includes multiple net- 
work devices, two of which are illustrated. Second network 
18 includes a third network device 20 and a fourth network 
device 22. Second network device 16 and third network 
device 20 are connected via a third network 24 (e.g., the 
Internet). 

In a preferred embodiment of the present invention, first 
network device 14 is a host network device (e.g., a 
computer), second network device 16 and third network 
device 20 are peer network devices (e.g., edge routers) and 
fourth network device 22 is a host network device. First 
network 12 and second network 18 are Autonomous Sys- 
tems and third network 24 is the Internet. However, other 
network devices, network types and network components 
can also be used and the present invention is not limited to 
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the network devices, network types and network compo- layers may be used in network layer 30 including an Internet 

nents described for a preferred embodiment. In addition, Control Message Protocol ("ICMP") layer 34. 

although illustrated with four network devices, network ICMP layer 34, hereinafter ICMP 34, is used for network 

system 10 typically includes tens to thousands of network management. The main functions of ICMP 34 include error 

devices in networks (12, 18). 5 ^reporting, reachaf islit^esting (t£g., "pinging") congestion 

An operating environment for network devices of a pre- control, route-change notification^ performance,' subnet 

ferred embodimentlfie present invention include a process- addressing and other maintenance/For more information on ; 

,ing system with at 'least one high speed Central Processing ^ ICMP 34 see RFC-792, incorporated herein By reference. 

Unit ("CPU") and a memory system. In accordance with the Above network layer 30 is a transport layer 36. Transport 

practices of persons skilled in the art of computer 10 layer 36 includes a Transmission Control Protocol ("TCP") 

programming, the present invention is described below with layer 38 and a User Datagram Protocol ("UDP") layer 40. 

reference to acts and symbolic representations of operations TCP layer 38, hereinafter TCP 38, provides a connection- 

that are performed by the processing system, unless indi- oriented, end-to-end reliable protocol designed to fit into a 

cated otherwise. Such acts and operations are referred to as layered hierarchy of protocols which support multi-network 

being "computer-executed" or "CPU executed." Although' is applications. TCP 38 provides for reliable inter-process 
described with one CPU, alternatively multiple CPUs mayz; communication between pairs of processes in network 

be used for a preferred embodiment of the present invention. devices attached to distinct but interconnected networks. For 

The memory system may include main memory and more information on TCP 38 see RFC-793, incorporated 

secondary storage. The main memory is high-speed random herein by reference. 

access memory ("RAM"). Main memory can include any 20 UDP layer 40, hereinafter UDP 40, provides a connec- 

additional or alternative high-speed memory device or tionless mode of communications with datagrams in an 

memory circuitry. Secondary storage takes the form of long interconnected set of computer networks. UDP 40 provides 

term storage, such as Read Only Memory ("ROM"), optical a transaction-oriented datagram protocol, where delivery 

or magnetic disks, organic memory or any other volatile or and duplicate packet protection are not guaranteed. For more 

non-volatile mass storage system. Those skilled in the art 25 information on UDP 40 see RFC-768, incorporated herein 

will recognize that the memory system can comprise a by reference. Both TCP 38 and UDP 40 are not both required 

variety and/or combination of alternative components. in protocol stack 26. 

It will be appreciated that the acts and symbolically Above transport layer is an application layer 42 where 
represented operations include the manipulation of electrical application programs reside to carry out desired functional- 
signals by the CPU. The electrical signals cause transfer- 30 ity for a network device reside (e.g., application programs to 
mation of data bits. The maintenance of data bits at memory provide "intelligent" services). More or fewer protocol lay- 
locations in a memory system thereby reconfigures or oth- ers can also be used in protocol stack 26. 
erwise alters the CPU's operation. The memory locations Peer Discovery Protocol 

where data bits are maintained are physical locations that FIGS. 3A and 3B are block diagrams illustrating compo- 

have particular electrical, magnetic, optical, or organic prop- 35 nents of a peer discovery protocol 44. However, more or 

erties corresponding to the data bits. fewer peer discovery protocol components could also be 

The data bits may also be maintained on a computer used. As is illustrated in FIG. 3A, peer discovery protocol 44 

readable medium including magnetic disks, optical disks, includes a peer discovery marker 46. Peer discovery marker 

organic disks and any other volatile or non-volatile mass includes a kind-field 48, a length- field 50 and a network 

storage system readable by the CPU. The computer readable 40 address-field 52. However, more or fewer fields could also 

medium includes cooperating or interconnected computer be used in peer discovery marker 46. In a preferred embodi- 

readable medium, which exist exclusively on the processing ment of the present invention, peer discovery marker 46 

system or may be distributed among multiple interconnected includes a 1-byte kind-field 48 containing a unique number 

processing systems that may be local or remote to the (e.g., 128). Length-field 50 is a 1-byte field indicating a 

E£2?ss^Sjiystem^_____ 45 length of the marker in bytes (e.g., 6 bytes). Network 

^Network Device Protocol Stack) address-field 52 is a 4-byte field containing a network 

FIG. 2 is a block diagram illustrating a layered protocol address (e.g., IP address) of a network device that wishes to 

stack 26 for a network device (e.g., 14, 16, 20, and 22) in be discovered. However, other field sizes and values could 

network system 10. Layered Protocol stack 26 is described also be used and the present invention is not limited to the 

with respect to Internet Protocol suites comprising from 50 field sizes and values described. 

lowest-to-highest, a link, network, transport and application As is illustrated in FIG. 3B, peer discovery protocol 44 

layer. However, more or fewer layers could also be used; and also includes a peer discovery table 54. Peer discovery table 

( different layer designations could also be used for the layers 54 includes a first column 56, or "peer-field", to store 

(in protocol stack 26 (e.g., layering based on the -Open network addresses for peer network devices. Peer discovery 

Systems Interconnection ("OSI") model)f 55 table 54 also includes a second column 58, or "peer host- 

Network devices (14, 16, 20, and 22) are connected to field", to store network addresses for host network devices 

networks (12, 18, and 24) with a link layer 28. Link layer 28 associated with the peer network devices. An exemplary 

includes Network Interface Card ("NIC") drivers for hard- peer discovery table entry is illustrated by row 60. However, 

ware network devices connecting the network devices to a more or fewer columns could also be used in peer discovery 

network (e.g., an Ethernet NIC). Above link layer 28 is a 60 table 54. 

network layer 30. Network layer 30, includes an Internet Network Device TCP Connection Establishment 

Protocol ("IP") layer 32. As is known in the art, IP 32 is an For two network devices to establish a connection with 

addressing protocol designed to route traffic within a net- TCP 38, a TCP 38 three-way handshake is used. FIGS. 4A, 

work or between networks, IP layer 32, hereinafter IP 32, is 4B and 4C are block diagrams illustrating TCP/IP three-way 

described in Internet Engineering Task Force ("IETF") 65 handshake segments 62. As an example, first network device 

Request For Comments ("RFC") RFC-791, incorporated 14 desires to establish a TCP 38 connection with fourth 

herein by reference. In addition to IP 32, other protocol network device 22. First network device 14 transmits a TCP 
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38 segment with a Synchronize sequence Numbers 
("SYN") flag set, called a "TCP 38 SYN segment" to fourth 
network device 22 using IP 32. FIG. 4A illustrates an 
exemplary TCP/IP SYN segment 64 sent from first network 
device 14 to fourth network device 22. TCP/IP SYN seg- 
ment 64 typically contains a TCP 38 Option for advertising 
a Maximum Segment Size ("MSS") that the network device 
can accept. TCP 38 allows multiple configuration Options to 
be set. For more information on TCP 38 Options see 
RFC-793. TCP/IP SYN segment 64 illustrates an exemplary 
IP 32 address for first network device 14 of 128.10.20.31 as 
source IP 32 address and an IP 32 address for fourth network 
device 22 of 110.11.12.15 as destination IP 32 address. 
TCP/IP SYN segment 64 includes other fields that are 
normally set in the segments illustrated in FIG. 4. However, 
such fields (e.g., TCP 38 header length, TCP 38 checksum, 
IP 32 total length) are not illustrated in FIG. 4. For more 
information on such fields see RFC-793. 

FIG. 4B illustrates an exemplary TCP/IP SYN ACKnowl- 
edgment segment 66. Fourth network device 22 responds to 
TCP/IP SYN segment 64 with "TCP/IP SYN ACK segment" 
66 with the TCP 38 SYN, ACKnowledgment ("ACK") and 
MSS option flags set and the IP 32 source and destination 
addresses reversed. 

FIG. 4C illustrates an exemplary TCP/IP ACK segment 
68. First network device 14 responds to TCP/IP SYN ACK 
segment 66 with a "TCP/IP ACK segment" 68 with ACK 
flags set. No TCP 38 option flags are set in the TCP/IP ACK 
segment. 

The TCP/IP segments illustrated in FIGS. 4A, 4B and 4C 
do not contain any data. The segments are sent in a data 
packet as TCP 38 and IP 32 headers only with no data 
segment. After sending the TCP/IP ACK segment 68, a TCP 
38 connection is established between first network device 14 
and fourth network device 22. TCP 38 data can then be 
exchanged using IP 32 via third computer network 24 (e.g., 
the Internet). 

Peer Network Device Discovery 

As was illustrated above, first network device 14 on first 
network 12 typically initiates a TCP 38 connection to fourth 
network device 22 on second network 18 via third network 
24. It is desirable to allow second network device 16 
functioning as an "edge router" to discover a network 
address of its peer edge router (e.g., third network device 20) 
as the TCP 38 connection between host network devices first 
network device 14 and fourth network device 22 is being 
established. Once the edge routers have discovered each 
other, they can establish a two-way peer-to-peer "data flow" 
(i.e., another TCP 38 channel or a UDP 40 channel):betweetf 
^themselves and -transmit information such as "intelligent" 
^routing capabilities, requests, or commands and other infor- 
; mation. Peer discovery is accomplished using peer discover 
protocol 44. 

FIG. 5 is a flow diagram illustrating a method 70 for peer 
network device discovery. At step 72, an original first data 
packet is received from first network device 14 on second 
network device 16 on first network 12. In a preferred 
embodiment of the present invention, the first data packet is 
a TCP/IP packet (e.g., TCP/IP SYN segment 64, FIG. 4A) 
used to establish a TCP 38 connection from first network 
device 14 on first network 12 to fourth network device 22 on 
second network 18. However, other data packets from other 
networking protocols could also be used. 

At step 74, peer discovery marker 46 from peer discovery 
protocol 44 is added to a header in the original first data 
packet on second network device 16 to create a modified first 
data packet. Peer discovery marker 46 includes a network 
address for second network device 16 (e.g., IP 32 address 
128.10.20.30). 
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FIG. 6 is a block diagram illustrating an exemplary peer 
discovery data packet 78 with a peer discovery marker 80 as 
a TCP 38 Option. Peer discovery data packet 78 is an 
exemplary modified first data packet created at step 74. In a 
preferred embodiment of the present invention, peer discov- 
ery marker appears as an additional TCP Option in the TCP 
38 header. However, peer discovery marker 46 may also be 
placed in another part of the TCP 38 header or in another 
networking protocol header. In addition, the present inven- 
tion is not limited to using the peer discovery marker 46 as 
a TCP 38 Option and other types of peer discovery data 
packets could also be used. 

Returning to FIG. 5 at step 76, the modified first discovery 
data packet is sent from second network device 14 on first 
network 12, to third network device 20 on second network 
18, via third network 24. 

In a preferred embodiment of the present invention, first 
network device 14 (FIG. 1) transmits a TCP/IP SYN seg- 
ment 64 (FIG. 4A) intended for fourth network device 22 
(FIG. 1) to establish a TCP 38 connection. As TCP/IP SYN 
segment 64 passes through second network device 16 (i.e., 
a first edge router), second network device 16 puts its own 
IP 32 address (e.g., 128.10.2030) in network address-field 
52 (FIG. 3A) of peer discovery marker 46. Kind-field 48 is 
set to 128 and length-field 50 is set to six, since the peer 
discovery marker is 6-bytes long. 

Peer discovery marker 46 is added to TCP 38 header as an 
additional TCP 38 Option identified by a option "kind" 
number of 128. The TCP 38 header is padded with TCP 38 
No Operation ("NOP") bytes until it ends on a four-byte 
boundary (i.e., 8-bytes). Since the TCP/IP SYN segments do 
not cany a data payload, adding a 6-byte peer discovery 
marker and two-bytes of padding for a total of 8-bytes, will 
not adversely increase the size of the SYN segment beyond 
any Message Transfer Unit ("MTU") previously defined by 
a network device. 

Second network device 16 adjusts three fields in the 
TCP/IP SYN segment: IP 32 total length; TCP 38 header 
length; and TCP 38 checksum (fields not illustrated in the 
segments from FIG. 4). The IP 32 and TCP 38 header lengths 
are increased by a fixed amount corresponding to the length 
of peer discovery marker 46. In a preferred embodiment of 
the present invention, the TCP 38 checksum is computed by 
adding (e.g., in 16-bits l's complement) the length of peer 
discovery marker 46 and associated padding to the original 
TCP 38 checksum. The original IP 32 length and TCP 38 
header length values are subtracted from the TCP 38 check- 
sum and the new IP 32 length and TCP 38 header length 
values are added to the TCP 38 checksum creating a new 
TCP 38 checksum. However, other methods can also be used 
to adjust the TCP 38 and IP header fields. 

FIG. 7 is a flow diagram illustrating a method 82 for peer 
network device discovery. At step 84, a modified first data 
packet (e.g., a TCP/IP packet with a peer discovery marker 
46 in a TCP 38 header) is received on third network device 
20 (i.e., a second edge router) on second network 18 via the 
third network 24. At step 86, information from the peer 
discovery marker in 46 the modified first data packet is 
extracted and stored in a first peer discovery table on the 
third network device 20 (e.g., the network address of second 
network device 16). At step 88, peer discovery marker 46 is 
deleted from the header in the peer discovery data packet by 
third network device 20 to recover an original first data 
packet (e.g., TCP/IP SYN segment 64). At step 90, the 
original first data packet is sent to fourth network device 22. 

In a preferred embodiment of the present invention, third 
network device 20 (i.e., second edge router) removes peer 
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discovery marker 46 from TCP 38 header. The network network address (i.e., IP 32 address 10.11.12.14) for peer 

address for the peer network device (e.(g., second network third network device 20 and its associated host, fourth 

device 16) from peer discover marker 46 is stored in a peer network device 22 (i.e., IP 32 address 110.11.12.15). 

discovery table along with the network address for the host In one embodiment of the present invention, peer third 

network device associated with the peer network device 5 network device 20 and peer second network device 16 

from the IP 32 header (e.g., from the IP 32 source field). execute the TCP 38 handshake sequence illustrated in FIG. 

FIGS. 8 A and 8B are block diagrams illustrating exem- 4 and described above to establish a two-way peer-to-peer 

plary peer discovery tables. FIG. 8A is a block diagram TCP 38 data flow (e.g., a TCP 38 channel) between peer 

illustrating an exemplary peer discovery table 92 for peer network devices. However, other peer-to-peer data-flows 

third network device 20 created as a result of execution of 10 may also be established between the peer network devices 

methods 70 (FIG. 5) and 82 (FIG. 7). Peer discovery table (e.g., a UDP 40 channel or other networking protocol 

86 (FIG. 8A) includes a network address (i.e., an IP 32 channel). 

address 128.10.20.30) for a peer network device, which is A two-way, peer-to-peer data flow is established between 

second network device 16, and a network address for its the peer network devices (16, 20) via third network 24 as 

associated host network device, first network device 14 (i.e., 15 first network device 12 and fourth network device 22 are 

128.10.20.31). establishing a TCP 38 connection. The peer-to-peer data 

Third network device 20 re-calculates the IP 32 length, flow is separate from the TCP 38 connection established 

TCP 38 header length, and TCP 38 checksum fields using an between first network device 14 and fourth network device 

inverse of the calculation described for adding peer discov- 22. 

ery marker 46 to the TCP 38 header. However, other 20 Peer second netwo^^evicej.6 is able to determine that 

calculations can also be used for removing peer discovery |ojurth«network device 22 is reached via peer "third network 

46. This inverse calculation recovers an original data packet device 20 with peer discovery table 96. Peer third network 

(e.g., TCP/IP SYN segment 64), which is sent to fourth device 20 is able to determine that first network device 14 is 

network device 22 to help establish a TCP 38 connection. reached via peer second network device 16 with peer 

FIG. 9 is a flow diagram illustrating a method 100 for peer 25 discovery table 92. The peer-to-peer network devices can 

network device discovery. At step 102, a second data packet now exchange routing "intelligent" routing capabilities, 

is created on third network device 20 after receiving a requests, or commands and other information ;jhe exchange) 

modified data packet with a peer discovery marker 46. In a of information allows the peer network devices 'to exchange 

preferred embodiment of the present invention, the second and negotiate "intelligent" edge router capabilities such as . 

data packet is a TCP 38 data packet. However, other data 30 error correction, encryption, compression, and other data 

packets could also be used (e.g., UDP 40 or other network- transmission parameters that may improve transmission 

ing protocol data packets). bandwidth between Autonomous Systems.- 

At step 104, third network device 20 adds its network In a preferred embodiment of the present invention, the 

address (e.g., IP 32 address 110.11.12.14) and a network modified first data packet is a TCP/IP data packet with a peer 

address (e.g., IP 32 address 110.11.12.15) for an associated 35 discovery marker 46 added to the TCP 48 header as an 

host network device to the second data packet. additional TCP 38 Option. In such an embodiment, if a 

At step 106, the second data packet is sent from third network device receives a modified data packet with peer 

network device 20 on second network 18 to peer second discovery marker 46, and the network device does not 

network device 16 on first network 12 via third network 24. implement peer discovery protocol 44 and the peer discov- 

Third network device 20 uses the second data packet to 40 ery methods described herein, peer discovery marker 46 is 

initiate a two-way peer-to-peer data flow to peer second ignored. The default action for TICP 38 upon receipt of an 

network device 16. The two-way peer-to-peer data flow is unknown TCP 38 Option is to silently ignore the unknown 

established outside of, and separate from, the TCP 38 TCP 38 Option. Thus, attempting to use the peer discovery 

connection being established between first network device protocol and methods with TCP 38 described herein, should 

14 and fourth network device 22. For example, the second 45 not have any adverse effects on existing network devices that 

data packet is sent from third network device 20 to peer do not implement peer discovery (i.e., assuming that a 

second network device 16 to establish a two-way peer-to- network device has a proper implementation of TCP 38 that 

peer data flow connection as second network device 16 is handles unknown TCP 38 options correctly), 

sending the TCP 38 handshake segments illustrated in FIG. The peer discovery protocol and peer discovery method 

4 to third network device 20 to establish a TCP 38 connec- 50 described here allow peer edge routers and other peer 

tion between first network device 12 and fourth network network devices to discover one another across a network 

device 22. like the^ Internet using existing networking protocols. The J 

FIG. 10 is a flow diagram illustrating a method 108 for Npeer network devices can then provide "intelligent" edge 
peer network device discovery. At step 110, a second data ^routSr" services such as error correction, encryption, corn- 
packet is received on second network device 16 on first 55 pressibn and other services^ The peer discovery protocol of 
network 12 via the third network 24 from third network the- present invention is used with existing networking 
device 20. At step 112, network address information for a protocols used for the Internet and can be used with network 
peer network device and its associated peer host network devices that do not implement the peer discovery protocol 
device is extracted from the second data packet. At step 114, without disruption. Thus, the peer discovery protocol and 
the network address information extracted from second data 60 peer discovery methods of a preferred embodiment of the 
packet is stored in a peer discovery table (e.g., peer discov- present invention may enhance performance, reliability and 
ery table 96 of FIG. 8B) on second network device 16. Peer security of data transmitted over the Internet to and from 
discovery table 96 (FIG. 8B) includes a network address Autonomous Systems or other subnets or networks, 
(e.g., an IP 32 address) for a peer network device, which is In view of the wide variety of embodiments to which the 
third network device 20, and a network address for its 65 principles of the present invention can be applied, it should 
associated host, fourth network device 22. Peer discovery be understood that the illustrated embodiments are exem- 
table 96 includes an exemplary table entry 98 illustrating an plary only, and should not be taken as limiting the scope of 
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the present invention. For example, the steps of the flow discovery protocol on the second network device, 

diagrams may be taken in sequences other than those thereby providing network addresses for establishing a 

described, and more or fewer elements may be used in the two-way peer-to-peer data flow between the second 

block diagrams. network device and the third network device via the 

The claims should not be read as limited to the described 5 third network, 

order or elements unless stated to that effect. Therefore, all 5 - A computer readable medium having stored therein 

embodiments that come within the scope and spirit of the instructions for causing a central processing unit to execute 

following claims and equivalents thereto are claimed as the the method of claim 1. 

invention. °* metnocl of claim 1 wherein the first network and 

We claim- 10 sccon( ^ networks are Autonomous Systems and the third 

1. In a first network with a plurality of network devices ne ! WC ?? ^ *° ten J et - . , 

connected to a second network with . plurality of network 7 " ^ 7\ thod ° f ^ ^^j* P ™ dwcov,B 7 

devices via a third network, a method of peer network device m , a . rker ' nc , 1 " t l es a kmd-fteld, a length-fieU and a network 

j- ,l j-l j ■ ■ 4U i- ii • * address- field for a Transmission Control Protocol Option, 

discovery, the method comprising the following steps: 0 ™ , , _ t . . , . , _ , *\ . 

. . • • i , r ? . , c 8. The method of claim 1 wherein the first data packet is 

receiving an original first data packet trom a first network » a Transmission Control Protocol ket ^ 

an Internet 

device on a second network device on the first network, Protocol packet 

wherein the first data packet is used to establish a ^ ^ metho£ , Qf ^ 1 ^ headef {q ^ ^ 



connection from the first network device on the first 



data packet is a Transmission Control Protocol header. 



network to a fourth network device on the second ^ 10 The method of daim x wherein ^ ^ netwQrk 

network; device is a network host computer and the second network 

adding a peer discovery marker from a peer discovery device is an edge router, 

protocol to a header in the first data packet on the i lt me thod of claim 1 wherein the peer discovery 

second network device to create a modified first data protocol includes a peer discovery marker and a peer dis- 

packet, wherein the peer discovery marker includes a covery table. 

network address for the second network device; and 25 u. The method of claim 1 wherein the step of adding a 

sending the modified first data packet from the second peer discovery marker includes re -calculating a length of the 

network device on the first network to a third network modified first data packet, a length of the header for the 

device on the second network via the third network. modified first data packet and a checksum for the header, 

2. The method of claim 1 further comprising: ^ with the peer discovery marker included in the header of the 

receiving the modified first data packet on the third modified first data packet. 

network device on the second network via the third 13. The method of claim 2 wherein the first peer discovery 

network; table includes a first network address-field for storing a first 

extracting information from the peer discovery marker in network address for a peer network device and a second 

the modified first data packet* 35 network address-field for storing a second network address 

storing information from the peer discovery marker in a *f r an ^iated host network device for the peer network 



first peer discovery table from a peer discovery proto- 



device. 



col on the third network device; 14 ^ method of claim 2 wherein the ste P of deletin S the 

.... ,. . - ..I-. peer discovery marker includes re -calculating a length of the 

deleting the peer discovery marker from the header in the . . , j ♦ i ♦ t 4U c *u u j c *u 

j T n j £ j * / ... original first data packet, a length of the header for the 

modified first data packet on the third network device 40 i£*j* i 4 j li 

4t _ . . ■ « a i j original first data packet, and a checksum for the header, 

to recover the original first data packet; and -T * i , A * ■ . . r 

& r ' without the peer discovery marker included in the header of 

sending the original first data packet to a fourth network tne j ata p ac k e t 

device on the second network to establish a connection 15 In a first Qetwork with a plurality of network devices 

between the fourth network device and the first network connected to a second network with a plurality of network 

device. devices via a third network, a method of peer network device 

3. The method of claim 2 further comprising: discovery, the method comprising the following steps: 
creating a second data packet on the third network device receiving a first data packet with a peer discovery marker 

after receiving the modified first data packet; from a peer discovery protocol on a first network 

adding a first network address for the third network device device; 

and a second network address for an associated host extracting information from the peer discovery marker; 

fourth network device to the second data packet; and storing information torn the peer discovery marker in a 

sending the second data packet from the third network first peer discovery table from a peer discovery proto- 

device on the second network to the second network col on the first network device; 

device on the first network via the third network, 55 deleting the peer discovery marker from the header on the 

thereby providing information for establishing a two- p^,- discovery data packet on the first network device 

way peer-to-peer data flow between the third network t0 recover an original data pac ket without the peer 

device and the second network device. discovery marker; and 

4. The method of claim 3 further comprising: sending lhe first da ' ta packet tQ a host netWQrk 
receiving the second data packet on the second network 60 device ass0 ciated with the first network device. 

device on the first network via the third network; 16. a computer readable medium having stored therein 

extracting a first network address for the peer third instructions for causing a central processing unit to execute 

network device and a second network address for the the method of claim 15. 

for the associated host fourth network device from the 17. In a first network with a plurality of network devices 
second data packet; and 65 connected to a second network with a plurality of network 

storing the first network address and the second network devices via a third network, a method of peer network device 

address in a second peer discovery table from a peer discovery, the method comprising the following steps: 
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receiving a second data packet on a first network device 
on the first network, wherein the second data packet is 
sent by a second network device on a second network 
in response to a first data packet including a peer 
discovery marker from a peer discovery protocol sent 
by the first network device; 

extracting a first network address for the second network 
device and a second network address for a host network 
device associated with the second network device from 
the second data packet; and 

storing the first network address and the second network 
address in a peer discovery table from a peer discovery 
protocol on the first network device, thereby providing 
network addresses for establishing a two-way peer-to- 
peer data flow between the first network device and the 
second network device. 

18. A computer readable medium having stored therein 
instructions for causing a central processing unit to execute 
the method of claim 17. 

19. A computer readable medium having stored therein a 
set of routines for implementing peer discovery protocol, the 
protocol allowing a first network device on a first network to 
discover a peer second network device on a second network, 
the set of routines implementing the peer discovery protocol 
as data bits, the computer readable medium comprising: 

a peer discovery marker, for creating a modified network- 
ing protocol data packet, wherein the peer discovery 
marker is added to a header of a networking protocol 
data packet and is used to discover a peer network 
device; and 

a peer discovery table, for recording network addresses 
for establishing a two-way peer-to-peer data flow 
between the first network device on the first network 
and the peer second network device on the second 
network via a third computer network with information 
from the peer discovery marker. 

20. The computer readable medium of claim 19 wherein 
the peer discovery marker includes a kind-field, a length- 
field and a network address-field for a Transmission Control 
Protocol Option. 

21. The computer readable medium of claim 19 wherein 
the peer discovery table includes a first network address- 
field for a peer network device and a second network 
address-field for an associated host network device for the 
peer network device. 

22. The computer readable medium of claim 19 wherein 
the header is a Transmission Control Protocol header. 

23. The computer readable medium of claim 19 wherein 
the networking protocol data packet is a Transmission 
Control Protocol packet with an Internet Protocol packet. 

24. In a first network with a plurality of network devices 
connected to a second network with a plurality of network 
devices via a third network, the network devices including 
a plurality of edge routers, a method of peer network device 
discovery, the method comprising the following steps: 

adding a peer discovery marker from a peer discovery 
protocol to a header in a first data packet on a first edge 
router to create a modified first data packet, wherein the 
peer discovery marker includes a first network address 
for the first edge router; 
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sending the peer discovery data packet from the first edge 
router on the first network to a second edge router on 
the second network via the third network; 

receiving a second data packet on the first edge router, 
wherein the second data packet is sent by the second 
edge router on a second network in response to the 
modified first data packet; 

extracting a second network address for the second edge 
router from the peer discovery marker and a third 
network address for a host network device associated 
with the second edge router from the second data 
packet; and 

storing the second network address and the third network 
address in a peer discovery table from a peer discovery 
protocol on the first edge router, thereby providing 
network addresses for establishing a two-way peer-to- 
peer data flow between the first edge router and the 
second edge router. 

25. The method of claim 24, further comprising: 
establishing a two-way peer-to-peer data-flow between 

the first edge router and the second edge router using 
the network addresses from the peer discovery table. 

26. A computer readable medium having stored therein 
instructions for causing a central processing unit to execute 
the method of claim 24. 

27. In a first network with a plurality of network devices 
connected to a second network with a plurality of network 
devices via a third network, the network devices including 
a plurality of edge routers, a method of peer network device 
discovery, the method comprising the following steps: 

receiving a modified first data packet with a peer discov- 
ery protocol marker on a first edge router on the first 
network from a second edge router on the second 
network; 

extracting a first network address for the second edge 
router from the peer discovery protocol marker and a 
second network address for a host network device 
associated with the second edge router from the modi- 
fied first data packet; 

storing the first network address for the second edge 
router from the peer discovery marker and the second 
network address from the modified first data packet in 
a peer discovery table from the peer discovery protocol 
on the first edge router; 

creating a second data packet on the first edge router in 
response to the modified first data packet; 

adding a third network address for the first edge router and 
a fourth network address for host network device 
associated with the first edge router to the second data 
packet; 

sending the second data packet from first edge router on 
the first network to the second edge router on the 
second network via the third network, thereby provid- 
ing network addresses for establishing a two-way peer- 
to-peer data-flow between the first edge router and the 
second edge router via the third network. 

28. A computer readable medium having stored therein 
instructions for causing a central processing unit to execute 
the method of claim 27. 
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